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A METHOD AND A SYSTEM FOR PROGRAMMING AN INDUSTRIAL ROBOT 

TO MOVE RELATIVE TO DEFINED POSITIONS ON AN OBJECT, INCLUDING 

GENERATION OF A SURFACE SCANNING PROGRAM 



TECHNICAL AREA AND PRIOR ART 

10 The present invention relates to a method, a system, a computer 
program, and a computer readable medium comprising a com- 
puter program for programming an industrial robot to move rela- 
tive to defined positions on an object, wherein the programming 
is based on a geometric model of the object. The object can ei- 

15 ther be a working object, a fixture, a grip device, or a tool. The 
invention is particularly useful in connection with programming 
of a robot path comprising a plurality of defined positions on the 
object, for example for painting, grinding, milling, welding, or 
gluing. However, the invention is also useful for programming 

20 individual positions, for example for spot welding or object grip- 
ping. 

It is well known technology to program an industrial robot using 
a CAD model of the object. The positions of the robot path are 

25 received from the CAD model. However, those positions have to 
be corrected with regard to geometric and kinematic errors of 
the robot, the tool, and the work object. Examples of such errors 
are deviations between the real object and the model, an error 
in the positioning of the robot relative to the surrounding, arm 

30 length errors, shaft attitude error, and shaft offset error of the 
robot. To be able to perform such a correction today, the robot 
has to be calibrated with high accuracy. 

Today, the accuracy of the robot is a huge problem when using 
35 the robots. It is very expensive to build a high-accuracy robot, in 
which each component is carefully measured, and the kinematic 
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parameters of the robot are calibrated by means of a laser 
measuring system. Calibration by means of laser and camera 
measuring systems exists, but are seldom used. Only the large 
car manufactures have an economy, and personnel, to be able 
5 to handle such a complex technology. As long as there does not 
exist any simple and inexpensive method for calibrating and 
programming industrial robots, those will only be used in com- 
panies having enough financial and personnel resources. 

10 OBJECT AND SUMMARY OF THE INVENTION 

The object of the present invention is to provide a method and a 
system to simplify calibration and programming of a robot. 

15 According to an aspect of the invention this object is achieved 
by a method characterized in that is comprises registering and 
storing a plurality of measuring points, each measuring point 
corresponding to a point on the surface of the real object ex- 
pressed in any coordinate system associated with the robot. De- 

20 termining the orientation and position of a geometric model of 
the current object relative to said coordinate system associated 
with the robot by adapting the geometrical model of the object 
and the measuring points to each other. For at least some of the 
measuring points the deviation between the measuring points 

25 and the corresponding points on the geometrical model are 
measured and said defined positions are adjusted based on said 
calculated deviations. The measuring points correspond to the 
positions of the robot when a predefined point on a tool, or on a 
measuring device corresponding to the current tool, measures 

30 different points on the surfaces of the object. 

By adapting measured values for the real object to the geomet- 
rical model of the object and then adjust the positions, to which 
the robot is to be moved, in dependence of the deviations be- 
35 tween the measured values and the model, it is possible to 
compensate a robot path for all geometric and kinematic errors 
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in a robot cell. Both calibration and programming are done by an 
intuitive method without having to write any robot program or 
show any robot program to the operator. There is no need for 
extra measuring equipment for measuring kinematic errors, the 

5 tool coordinate system and the object coordinate system. In- 
stead, the operator uses the robot for the measuring and the 
measuring is very simple. The measuring can either be per- 
formed automatically, or the operator points with the tool, or with 
a particularly adapted measuring device, on different surfaces 

10 and/or edges of the object to be calibrated. The robot program 
can then be generated automatically by a CAD system or feed 
by lead through by the operator. Lead through means that the 
operator simply moves the tool along the path, which is later to 
be executed by the robot. The method can also be useful for 

15 programming of fixtures, conveyors and other manipulators, 
which shall cooperate with the robot. 

According to a preferred embodiment of the invention the 
method comprises calculating one or a plurality of characteristic 

20 parameters for a plurality of different parts of the object based 
on the geometrical model of the object. To which part of the ob- 
ject a measuring point belongs is determined based on said 
characteristic parameters, and said adapting of the geometrical 
model of the object to the measuring points comprises adapting 

25 measuring points belonging to a certain part of the object to cor- 
responding part of the geometrical model. It is advantageous if 
said parts comprise surfaces and edge lines of the object. It is 
advantageous if said characteristic parameters comprise the 
normal direction relative to the surface of the object and the 

30 bending of the surface of the object. It is advantageous to adapt 
the geometrical model of the object and the measuring points to 
each other by minimizing the distance between the measuring 
points and corresponding points on the geometrical model of the 
object. By first determining to which part of the object each 

35 measuring point belongs, and then adapting one part at a time 
the adaptation is simplified. 



WO 2004/071717 



4 



PCT/SE2003/002003 



According to a preferred embodiment of the invention, the 
method comprises providing geometric models for a plurality of 
different objects, calculating a plurality of characteristic parame- 
5 ters for each of the objects based on the geometrical model of 
the object and determining to which of the objects the measuring 
points belong, based on the measuring points and said charac- 
teristic parameters. It is advantageous if said characteristic pa- 
rameters comprise the normal direction relative to the surface of 
10 the object and the bending of the surface of the object. In that 
way the system automatically identifies the object and deter- 
mines which geometric model to be used during programming. In 
an alternative embodiment the operator himself feeds informa- 
tion about which object to be used during programming. 

15 

According to a preferred embodiment of the invention the sur- 
faces of the object are divided into a plurality of subsurfaces, 
each comprising at least one measuring point, calculating a cor- 
rection vector based on the deviation between the measuring 

20 point/points on the subsurface and corresponding point/points 
on the geometrical model of the object, and adjusting said de- 
fined positions based on the correction vectors for the subsur- 
faces belonging to the positions. It is advantageous to calculate 
the correction vector for a subsurface by calculating an average 

25 value of the deviations for all measuring points in the subsur- 
face. An advantage with dividing the surfaces into subsurfaces, 
and to use a plurality of measuring values to calculate a correc- 
tion vector for each subsurface, is that noise and occasional 
variations in the measuring values are filtered away. 

30 

According to a preferred embodiment of the invention the edge 
lines of the object are divided into a plurality of line segments, 
each comprising at least one measuring point, calculating a cor- 
rection vector based on the deviation between the measuring 
35 point/points in the line segment and corresponding point/points 
on the geometrical model of the object, and adjusting said de- 
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fined positions based on the correction vectors for line segments 
in the vicinity of the defined positions. It is advantageous to cal- 
culate the correction vector of a line segment as an average 
value of the deviations for all measuring points on the line seg- 
5 ment. An advantage with dividing the edge lines into lines seg- 
ments, and to use a plurality of measuring values for calculating 
a correction vector for each subsurface, is that noise and occa- 
sional variations in the measuring values filtered away. 

10 According to a preferred embodiment of the invention, said de- 
fined positions are defined relative to the geometrical model and 
the defined positions are transformed to said coordinate system 
associated with the robot, based on the determined orientation 
and position of the geometrical model relative to the coordinate 

15 system associated with the robot. In an embodiment of the in- 
vention the definition of the positions, which the robot is about 
to run through, done in a CAD system and the positions are po- 
sitioned on the model of the object. Accordingly, the positions 
are defined in the object coordinate system. To make it possible 

20 to program the robot so that it moves to those positions, the po- 
sitions have to be transformed to a coordinate system associ- 
ated with the robot. This transformation is given by the earlier 
determined orientation and position of the geometrical model 
relative to the coordinate system associated with the robot. 

25 

According to an embodiment of the invention, the measuring 
points are generated by the operator moving the robot so that 
the current tool, or a corresponding measuring device, will be in 
contact with the surfaces of the object. The measuring points 

30 correspond to positions of the robot when the tool, or a measur- 
ing device corresponding to the current tool, is in contact with 
different points on the surface of the object. This method is suit- 
able for a robot having a low movable mass, which makes it 
possible for the operator to move the robot to the desired posi- 

35 tions by using his hand. However, most industrial robots today 
have a high movable mass, and to fulfill the security demands 
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during measuring a separate programming box having "dead 
man's control" has to be used, which means that generating 
measuring points with this method takes too long time. 

5 According to an embodiment of the invention, the method com- 
prises generating a surface scanning program for automatic con- 
trol of the movements of the robot during measuring of said 
measuring points. Thereby, the operator does not have to move 
the robot to the measuring points, instead the movements of the 
10 robot are automatically controlled by the surface scanning pro- 
gram. Thanks to the automatic surface scanning program, the 
measuring points are quickly generated, and the safety of the 
operator is also guaranteed. 

15 According to an embodiment of the invention the sensor is 
mounted on the tool, or on a member corresponding to the cur- 
rent tool, and the sensor cooperates with the robot during gen- 
eration of said measuring points. Since the measuring points are 
generated the before the robot is calibrated, the exact position 

20 of the robot relative to the object is not known, and thus there is 
not possible to control the robot exact to contact with the sur- 
face of the object, without having any feed back. To solve this 
problem some kind of sensor that cooperates with the robot is 
used for generating the measuring points. For example, a sen- 

25 sor could be used that provides a signal to the robot when being 
in contact with the surface of the object. When receiving that 
signal, the robot interrupts its motion. The measuring points cor- 
respond to the positions of the robot when the sensor is in con- 
tact with the surfaces of the object. This method is called "find 

30 and stop". 

Another suitable type of sensor is a positioning sensor, which is 
adapted for measuring the distance between the surface of the 
object and some part of the robot, preferably the tool holder of 
35 the robot. In such a way the determination of the position of a 
measuring point can be carried out with the robot at a distance 
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from the object. During measuring, the robot is moved to a posi- 
tion in the vicinity of the measuring point. The distance between 
the robot and the measuring point is measured by the sensor, 
thereafter the position of the measuring point is determined 
5 based on the position of the robot during the measuring and the 
measured distance between the robot and the surface of the ob- 
ject. 

According to an embodiment of the invention the programmed 
10 movement comprises that the robot is moved so that the sensor 
is in contact with the surface of the object during the measuring 
and that the robot thereafter is moved to a transfer point posi- 
tioned at a distance from the surface of the object. This em- 
bodiment is useful when using a sensor measuring the contact 
15 between the sensor and the object. The measuring starts from a 
position a distance from the surface of the object, and the robot 
is then moved in a direction towards the surface until it reaches 
the intended position, or until contact with the sensor. 

20 According to an embodiment of the invention, the orientation of 
the current tool is stored in the defined positions, and the pro- 
gram is generated so that the tool, or the measuring device cor- 
responding to the tool, has about the same orientation in the 
measuring point as the stored orientation. To minimize the influ- 

25 ence of the kinematic errors of the robot on the difference be- 
tween the measured surfaces of the object and the defined posi- 
tions, the surface scanning program is generated with the same 
orientation of the tool as should later be used in the process 
program. 

30 

According to an embodiment of the invention, the positions of 
the measuring points are determined off-line based on the geo- 
metrical model of the object. The positions of the measuring 
points are advantageously determined in the same CAD-system, 
35 as in which the geometrical model of the object is stored. An ad- 
vantage with this embodiment of the invention is that the surface 
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scanning program can be generated without using the robot. 
Thus, it is possible to, easily and with high accuracy, find opti- 
mum positions and orientations for the measuring points. During 
calibration, the object surfaces are quickly measured, which 
5 means that the time the robot has to stand still for calibration is 
short. 

According to a further embodiment of the invention, the method 
comprises measuring a plurality of positions, comprising at least 

10 one start position and one stop position, on the surface of the 
real object, and automatically generating the positions of the 
measuring points based on the measured positions. Preferably, 
said plurality of positions is measured by means of the robot. An 
advantage with this embodiment is that the operator can specify 

15 within which range the surface scanning program should gener- 
ate measuring points. Thus, an uncertain zone along the edges 
of the object, in which zone it is uncertain weather the sensor 
will hit the object or not during the measuring, is avoided. 

20 According to a further aspect of the invention, this object is 
achieved by a computer program directly loadable into the inter- 
nal memory of the computer, which computer program com- 
prises instructions to make the processor perform the steps in 
the method according to the invention when said computer pro- 

25 gram is run on the computer. The computer program is provided 
for example on a computer readable medium or via a network, 
such as the Internet. A computer program according to the in- 
vention can either be executed by a processor in the control 
system of the robot, in the CAD system, or in a separate com- 

30 puter. 

According to a further aspect of the invention, this object is 
achieved by computer readable medium comprising computer 
program comprising instructions for making a processor to per- 
35 form the steps in the method according to the invention when 
said computer program is run on the computer. 
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According to a further aspect of the invention, this object is 
achieved by a system for programming an industrial robot to 
move relative to defined positions on an object, wherein the sys- 
5 tern comprises a geometric model of the object, which system is 
characterized in that it further comprises the real object, an in- 
dustrial robot, wherein the real object and the robot are ar- 
ranged so that it is possible to, by means of the robot, generate 
a plurality of measuring points corresponding to different points 

10 on the surface of the real object expressed in any coordinate 
system associated to the robot, a calibration module, arranged 
to determine the orientation and position of the geometrical 
model relative to said coordinate system associated with the ro- 
bot, by adapting the measuring points to the geometrical model 

15 of the object, a calculating module arranged for calculating de- 
viations between the measuring points and corresponding points 
on the geometrical model, and an adjusting module arranged for 
adjusting said defined positions based on said calculated devia- 
tions. 

20 

According to a preferred embodiment of the invention, the sys- 
tem comprises a measuring device adapted to being in contact 
with the surface of the object during measuring, wherein the 
measuring device has a centre point corresponding to the tool 

25 centre point (TCP) for the current tool. To facilitate the measur- 
ing, the system comprises a measuring device, for example a 
measuring tip, which during the measuring either replaces the 
tool, or is provided on the tool. The tool centre point of the 
measuring device should be the same as the tool centre point of 

30 the tool. 

According to a preferred embodiment of the invention, the 
measuring device is adapted to, during contact with the object, 
submit a signal, and the system is adapted to, in reply to said 
35 signal, generate at least one measuring point based on the posi- 
tion of the robot. To facilitate the measuring, a signal is gener- 
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ated when the measuring device is in contact with the surface of 
the object, wherein the position of the robot is read at contact 
between the measuring device and the surface of the object. 

5 SHORT DESCRIPTION OF THE DRAWINGS 

The present invention will now explained by the description of 
different embodiment examples and with reference to the ap- 
pended figures. 



10 



Fig. 1 shows a system for programming an industrial robot ac- 
cording to an embodiment of the invention. 



Fig. 2 shows a block diagram over the system according to an 
15 embodiment of the invention. 

Fig. 3 shows an example of definitions for object classification 
and measuring point classification. 

20 Fig. 4 illustrates the function of the classification module. 

Fig. 5 illustrates the function of the calibration module. 

Figs. 6-10 show the function of the adjusting module. 

25 

Fig. 1 1 shows an example of program editing. 

Fig. 12 shows an embodiment having a TCP fix in the room. 

30 Fig. 13 shows calibration of the tool. 

Fig. 14 shows an example adapted for an arc welding applica- 
tion. 



35 



Fig. 15a shows a tool tracking a process path on an object. 
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Fig. 15b shows a measuring device measuring a plurality of 
measuring points on the object. 

Fig. 16 shows an example of an automatically generated robot 
5 path for measuring points on the surface of the object by 

means of an LVDT sensor. 

Fig. 17 shows an example of an automatically generated robot 
path for measuring points on the surface of the object, 
10 with sensor adapted for contactless measuring. 

Fig. 18 shows automatic generation of measuring points, with 
regards to he uncertainty of the placement of the object 
relative to the sensor during the measuring. 

15 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Fig. 1 shows an example of a system for programming an indus- 
trial robot according to the invention. The system comprises an 

20 industrial robot 1, from now on denoted the robot, which com- 
prises a manipulator 2, and a control system 3 for controlling the 
movements of the robot. The control system comprises a model 
of the kinematic of the robot. The system further comprises a 
work object, on which the robot is about to perform some kind of 

25 process, for example welding, painting or grinding. Further, the 
system comprises a computer 5, in which the software of the in- 
vention is stored, and in which the software is executed. The ro- 
bot, as shown in the figure, is an industrial robot having six 
axes, and comprising a base 7 fixedly mounted on a foundation 

30 and a stand 8, which is rotateable in relation to the base about a 
first axis. In the upper end of the stand, a first robot arm 9 is ro- 
tateably mounted in relation to the stand about a second axes. 
In the outer end of the first arm, a second arm 10 is rotateably 
mounted in relation to the first arm about a third axes. The sec- 

35 ond robot arm comprises two parts, wherein the outer part is ro- 
tateable in a relation to the inner part about a fourth axes. The 
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second arm 10 carries in its outer end a tilt member 11, which is 
rotateable about a fifth axes. The robot also comprises a tool 
holder 12, which is rotateable in relation to the tilt member 
about a sixth axes. 

5 

A measuring device is mounted on the tool holder, which meas- 
uring device comprises a measuring tip 14. The outer end of the 
measuring device is formed as a tip and forms the measuring tip 
14. The outer part of the measuring tip is intended for being 

10 brought into contact with the surface of the object 4. The TCP 
("Tool Center Point") of the measuring device shall be the same 
as TCP for the tool to be used during the process. Alternatively, 
the measuring tip can be mounted directly on the tool to be 
used. During arc welding, the measuring tip is mounted on the 

15 welding pistol with the outermost part of the tip in the position 
where the welding arc normally ends. During polishing, a dummy 
axis, provided with a measuring tip, is mounted in the spider 
keeper, instead of the polishing tool. The TCP of the measuring 
tip shall be the same as TCP for the polishing tool, which nor- 

20 mally is in the center of the polishing wheel. To facilitate the 
measuring, an electric signal can be connected between the 
measuring tip and the current object, and the robot position is 
read when connection is made, i.e. when the measuring tip is in 
contact with the surface or the edge to be measured. 

25 

During measuring, the measuring tip 14 is moved forward and 
backward over the accessible surfaces of the object. From now 
on a surface on an object is denoted an object surface. The ori- 
entation of the tool is about the same way as for the current 

30 process. For example, in the polishing case the pad is kept per- 
pendicular to the surfaces to be measured. To be able to com- 
pensate the appropriate kinematic errors, it is important to keep 
the tool orientation about the same as in the current process. 
The more measuring points received, the better will the calibra- 

35 tion be. To obtain a satisfactory result, at least three points 
should be measured for each object surface, and at least two 
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points should be measured for each edge line on the object. The 
control system of the robot calculates the positions of the meas- 
uring points in the base coordinate system of the robot. In an 
alternative embodiment, the control system calculates a position 
5 in any other coordinate system, which is associated with the ro- 
bot. The measuring is done by means of a kinematic model of 
the robot. 

It is an advantageous if the robot has a control mode for manual 
10 (lead through) positioning. This means that the robot operator 
easily can position and orientate the tool, or the work object, 
carried by the robot by gripping the tool, or the object, with his 
hands. One possibility to directly manipulate the robot, i.e. with- 
out using a programming box with a joystick, is to introduce a 
15 force sensor coupled to a control algorithm in the control system 
that converts the hand power of the operator to robot move- 
ments. For this purpose, the robot has to be entirely safe so that 
the operator will not be hurt due to an error. One possibility to 
fulfill this obligation is to use a parallel kinematic robot having 
20 such a low arm weight that the robot during maximum engine 
power and speed cannot seriously hurt the operator. Meanwhile, 
there should be redundant systems for error detection in the 
control system. 

25 Fig. 2 shows a block scheme of the modules included in the sys- 
tem. Besides the robot 1, the measuring tip 14 and the object 4, 
the system comprises a CAD-module 15, providing geometric 
models of different work objects and tools, a classification mod- 
ule 16, which comprises a part classification module 16a, which 

30 determines to which part of the object a particular measuring 
point belongs, and an object classification module 16b, which 
determines to which object, or tool, the measuring points be- 
long, a calibration module 17, which determines the orientation 
and position of the geometrical model relative to the robot, a 

35 calculating module 18, which determines the deviation between 
the measuring points and corresponding points on the geometri- 
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cal model, and calculates the correction vectors that are used 
later for correcting the defined positions to which the robot is to 
be moved, when carrying out the process, and an adjusting 
module 19, which is arranged to adjust the defined positions on 
5 the object, to which the robot is be moved, in dependence of the 
correction vectors. 

The positions of the measuring points, in any of the coordinate 
systems of the robot, are calculated in the control system of the 
10 robot based on the kinematic model and the location of the axes 
of the robot at the measuring time. The measuring points are 
later transferred from the control system to the classification 
module 16 for further processing. 

15 In the CAD-module 15 there are geometric models of a plurality 
of different work objects, and tools to be used in the current ro- 
bot cell. The geometrical models consist of CAD models. In the 
CAD models each point on the surface of the object can be cal- 
culated from for example "spline" functions, line equations or 

20 surface equations. In each point on the surface of the object it is 
possible to, by means of surrounding points on the surface of 
the object, calculated such characteristic parameters as the 
normal direction of the surface, and the bending of the surface 
in different directions. In discontinuous junctions between differ- 

25 ent surfaces, the points in edge lines can be provided with spe- 
cial characteristic, such as direction of the line, bending of the 
line and designations of connected surfaces. These are exam- 
ples of possibilities to make surface points unique. 

30 To make surfaces unique, parameters characterizing the points 
on the surfaces may be used, for example the average normal 
angle, the spreading in the normal direction, the surface area, 
the average bending of the surface. In the same way, the edge 
lines can be made unique with parameters for average direction, 

35 average bending, length of the line etc. For an entire object the 
relations between the defined surface and the edge lines can be 
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used, for example which normal directions are represented, how 
the normal directions of the surfaces are related to each other, 
which surfaces are delimited by the edge lines, and the relation 
between different directions of edge lines. 

5 

Fig. 3 shows some definitions for object classification. The ob- 
ject 34 has a plurality of object surfaces 20, and a plurality of 
edge lines 21. On the object surface there are a plurality of 
measuring points 22 indicated with cross. In the figure an object 
10 coordinate system 23 is shown. The object coordinate system is 
connected to the object, and all points on the object are related 
to the object coordinate system. 

Possible classification measures for. object surfaces are: 
15 - Average, maximum and minimum normal directions relative to 
other object surfaces. 

- Average, maximum and minimum bending angles in different 
directions relative to other object surfaces. 

- The position of the center of gravity of the object surface and 
20 the area of the object surface relative to other object surfaces. 

- Lengths of calculated edge lines which are connected to the 
object surface. 

Possible classification measures of objects are: 
25 - The classification measures for the included object surfaces. 

- The classification measures for edge lines. 

- Spectrum of classification measures for measuring points. 

In fig. 3 an example of a bending measure in the form of a con- 
30 vex bending angle 25, and a normal vector 26 of a measuring 
point P are shown. 
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Possible classification measures for measuring points in one 
plane are: 

- Normal direction relative to other measuring points. To deter- 
mine the normal direction, at least two assisting measuring 

5 points are needed. 

- A bending angle in at least one direction. To determine the 
bending angle, at least one distance measuring point is needed. 

- Coefficients in a "spline" through the point. To determine those 
coefficients at least two assistance points are needed. 

10 - Distance to other measuring points, for example to extreme 
points. 

Possible classification measures for edge lines, which are calcu- 
lated by the intersection between identified plans, are: 
15 - The tangential direction relative to other edge line points. To 
determine the direction of the tangent, at least one assistance 
measuring point is needed. 

- Bending angle along the edge line. To determine the bending 
angle, at least one assistance point is needed on the edge line. 

20 - Coefficients in a "spline" through neighboring edge line points. 
To determine those coefficients at least two assistant points are 
needed. 

- Distance to other edge line points, for example to extreme 
points. 

25 

Tables over characteristic parameters for surface points, sur- 
faces and edge lines of the current CAD models are automati- 
cally generated in the classification module using data from the 
CAD-module. Using those parameters this module classifies the 
30 measuring points read by the robot when the measuring tip is in 
contact with the surfaces of the real object. Thus, the measured 
points will be marked with the objects, surfaces and edge lines 
to which they belong. When the classification is certain, those 
data is handed over to the calibration module. 

35 
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Fig. 4 shows the function of the classification module 16 in more 
detail. In the figure a plurality of measuring points 30 are shown, 
each measuring point is denoted with an x in the figure, which 
correspond to positions on the real object. The measuring points 

5 P n are measured by the robot kinematic 31. The control system 
of the robot calculates the positions of the measuring points in 
the base coordinate system 32 of the robot. The calculation is 
done by means of a kinematic model for the robot. In the CAD- 
module an object coordinate system 23 is defined, and a CAD 

10 model 34 of the object, described in the object coordinate sys- 
tem. The measuring points are classified, which means that it 
has been determined to which object the measuring points be- 
long, and to which object surface or edge line the measuring 
points belong. Thus, for each measuring point it is decided to 

15 which object surface or edge line the measuring point belongs. 
A table is provided for each object surface, in which table the 
included measuring points are listed. This means that the meas- 
uring points 36 are positioned on the surfaces of the CAD 
model. This positioning can be considerably simplified, if the 

20 demand on the system to be able to recognize the object, is not 
so important, but instead the systems knows which is the current 
object, and the system shows the operator which surfaces or 
edges he should measure with the robot on a viewing screen. 
For example, the operator may provide the system with informa- 

25 tion about which object to be calibrated. 

It is possible to read more details about how to perform the 
classification and recognition of objects in the document "CAD- 
based object recognition for a sensor/actor measurement robot" 
30 by Claus Brenner, Jan Bohm and Jens GOring. This document 
was displayed on the Internet, 11 February 2003 and was found 
on the following address: 
ifp.uni-stuttgart.de/publications/1998/CAD.pdf. 

35 There is more to read about classification in the document 
"Automated extraction of features from CAD models for 3D ob- 
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ject recognition" by Jan B6hm, Claus Brenner, Jens GQring and 
Dieter Fritsch, (ISPRS, Vol XXXIII, Amsterdam 2000) which was 
found on the Internet 11 February 2003 on the following ad- 
dress: 

5 ifp.uni-stuttgart.de/publications/2000/Boehm_Amsterdam.pdf 

In the calibration module 17 a best possible adaption of the 
measuring points to corresponding points in the CAD model is 
carried out. For example the distance between the measuring 

10 points and the points on the surface of the CAD model could, for 
each object surface, be minimized by least mean square through 
translation in three degrees of freedom and rotation in three de- 
grees of freedom. A corresponding method could be used for 
edge lines, and at last the distance between all measured points 

15 on the object and corresponding points on the CAD object can 
be minimized for the whole object, or at least for all surfaces 
and edge lines that have been measured. By means of this 
adaption, the position and orientation of the object that best fits 
the points measured by the robot is obtained. It is assumed that 

20 the TCP of the measuring tip is known, as Well as the nominal 
kinematic of the robot. Thus, what the calibration module does is 
to place, i.e. locate and orientate, the object coordinate system 
23 of the object relative to the base coordinate system 32 of the 
robot, in such a way that the best possible matching is obtained 

25 between measured points on the object and theoretical points on 
the CAD model. 

In an alternative embodiment, the least means square adaption 
can be replaced with other optimization algorithms, for example 
30 Gauss-Newton. 

The function of the calibration module is shown fig. 5. The ob- 
ject coordinate system 23 is located and oriented relative to the 
base coordinate system 32 of the robot to obtain the best possi- 
35 ble adaption between measuring points and corresponding clas- 
sification surfaces, or edge lines, of the CAD model. In a first 
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step, the classified measuring points for each object surface can 
be positioned for performing of a least means square matching 
of, for example normal vector direction, bending of the path, and 
position relative to the CAD model. Thereafter, the measuring 

5 points are matched for two object surfaces, three object sur- 
faces and so on, at the same time relative to the CAD model, 
until least means square adaptations are obtained for all classi- 
fied measuring points to the CAD model. This method can be 
replaced with, or supplemented with, a calculation of the edge 

10 lines between the plane, for which matching of measuring points 
has been done, and later the measured edge lines is least 
means square adapted with the edge lines in the CAD model. 

The calibration module 17 optimizes the location of the current 
15 object, but does not do anything about the remaining deviations 
between measuring points and surfaces or edge lines of the 
CAD model. Those deviations are stored in the calculating mod- 
ule 18, to be used later for compensating the robot kinematic in 
the adjusting module 19. In the calculating module 18, the object 
20 surfaces are divided into subsurfaces, and the edge lines are 
divided into line segments. Each subsurface and each line seg- 
ment should at least contain one measuring point for calculation 
of a representative error vector. A suitably direction of the error 
vector is perpendicular to the subsurface, or the line segment, 
25 as defined by the CAD model. Error vectors for a measuring 
point is a vector that reaches from the point of the surface of the 
model, corresponding to the measuring point, to the measuring 
point itself. An error vector has both length and direction. 

30 A correction vector is calculated for each subsurface. For exam- 
ple, the average value of the error vectors for the measuring 
points belonging to the subsurface could be used as a correction 
vector. The length of the correction vector is determined as the 
average value of the length of the error vectors, and the direc- 

35 tion of the correction vector is determined as the average value 
of the direction of the error vectors. In the case when compen- 
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sation is made for edge lines, the direction of the correction vec- 
tor is naturally given by the average direction of the error vec- 
tors for the current line segment. It is also suitable to use the 
same error vector direction for neighboring subsurfaces of the 
5 object surfaces, to which the edge line border. 

In applications where accuracy parallel to the object surface is 
important, the error vectors may also contain lateral compo- 
nents. Those components are calculated for example from the 
10 normal error vectors of neighboring object surfaces, which nor- 
mal directions form an angle to the normal direction of the cur- 
rent surface. 

In fig. 6 an object surface 40 of the object 4 is shown, which is 
divided into a number of subsurfaces 42. The measuring points 
are denoted with a cross in the drawing. A subsurface 42 is the 
surface defined by the CAD model. The measuring points are 
positioned, dependent of the remaining measuring point error, at 
a distance from the CAD subsurface 42. The remaining measur- 
ing point error depends for example on kinematic error, trans- 
mission error, gravity induced bending, changes in the robot ge- 
ometry due to changes in the temperature, and errors in the 
, TCP. In the figure, a plurality of measure point positions 44, 
relative to the CAD model, after the object calibration according 
to fig. 5 are shown. A number of error vectors 48 are obtained, 
which lengths and directions are decided by the distance and 
direction between the measuring points 44 and corresponding 
points 45 on the surface of the CAD model. A correction vector 
46 is calculated for each subsurface. The correction vector is 
calculated as the average error for the subsurface, i.e. the aver- 
age value of the error vectors 48 is calculated. 

An alternative to the using of subsurfaces is compensation with 
the closest error vector for closest measuring point, or by using 
35 the average value of the error vectors of the n number of closest 
measuring points. 
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A robot path is defined by defining a plurality of positions, which 
the robot is to run through along the path. Those defined posi- 
tions are input data to the robot programming. When the posi- 

5 tions are defined, the robot program can be automatically gen- 
erated. Those positions can for example be defined in the CAD- 
module 15, by means of the CAD model of the object. Before a 
path, defined in the CAD-module, can be transferred to the robot 
control system, the positions of the path have to be adjusted in 

10 dependence of the remaining measuring point errors. The de- 
fined path positions are compensated by using the error vectors 
stored for the subsurfaces or line segments, through which the 
path run through. To achieve a smooth compensation along the 
path, a smoothing is carried out, by means of filtering the length 

15 of the error vectors in the transitions between the subsurfaces 
or line segments. 

Fig. 7 shows how a robot path 50, defined in the CAD model, is 
adjusted by using the stored correction vectors 46, which are 

20 the average error of the error vectors 48 in the subsurface 42. 
The robot path 50 is compensated by adjusting it in the normal 
direction of the surface, a distance that corresponds to the size 
of the correction vector 46 for the subsurface. By adjusting the 
robot path for each subsurface, a new adjusted robot path 52 is 

25 produced. When the adjusted robot path 52 is used as a refer- 
ence to the robot, the TCP of the tool will follow the surface of 
the real object, as pointed out by the path program in the CAD 
model. 

30 Fig. 8 shows the compensation of a robot path 60, programmed 
in the CAD model, where the path is compensated for errors in 
two directions. In the figure, a first object surface 40 is shown, 
and a second object surface 64, neighboring to the first object 
surface. An edge line 65 divides the object surface 40 and the 

35 object surface 62. The edge line 65 is the intersection between 
the object surfaces 40 and 64. In the CAD model there is an 
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edge line 66 corresponding to the edge line 65. The edge line 
66 in the CAD model is adjusted to be in accordance with a cor- 
responding edge line on the object. The adjusting of the edge 
line 66 is based on the correction vectors 67 and 68 of neighbor- 
5 ing subsurfaces in the object surfaces 40 and 64. The edge line 
adjusted in such a way is denoted 69 in the figure. The path 60, 
programmed in the CAD model, is compensated in dependence 
of the average error in the normal direction of the subsurface of 
the objective surface 40, i.e. the correction vector 67, and the 
10 average error in the plane of the subsurface given by the aver- 
age error of the closest subsurface o the object surface 64, pro- 
jected on the subsurface in the object surface 40, i.e. the cor- 
rection vector 68. In that way the path will be compensated for 
errors in two directions. 

15 

Fig. 9 shows how a robot path 82, programmed in the CAD 
model, is compensated for errors in three directions. An edge 
line 76 is calculated as the intersection between the object sur- 
face 40 and an object surface 74. An edge line 78 is calculated 

20 as the intersection between the object surface 40 and the object 
surface 64. Adjusted edge lines 80 are calculated in depend- 
ence of the correction vectors of neighboring subsurfaces in the 
object surfaces 40, 64 and 74. In the figure, the compensated 
path 80 is shown, which is compensated for errors in three di- 

25 rections. The correction vectors can either be obtained from 
neighboring object surfaces, or neighboring edge lines. 

Fig. 10 shows an alternative embodiment, wherein the compen- 
sation is done by means of the closest error vector in the closest 

30 object plan. This can be extended with the average value of the 
n closest error vectors in respective object plan. In the figure, 
86 denote a first object plan, and 88 denote a second object 
plan. Path 90 is programmed in the CAD model and path 91 is 
the compensated path. As shown from the figure, the compen- 

35 sated path becomes irregular with sharp transitions between dif- 
ferent segments of the path. To reduce the noise of the com- 



WO 2004/071717 



23 



PCT/SE2003/002003 



pensated path and to obtain a smoother path, the positions of 
the path can be filtered with respect to the path length. 

When a path, generated by lead through of the robot, is about to 
5 be stored in the CAD model, for example to later be stored in 
other robots, a reversed compensation is done by using the 
stored error vectors. 

In the following an embodiment of a method for programming an 
10 industrial robot according to the invention is described. The ob- 
ject to be machined is fixedly positioned in its fixture. Alterna- 
tively, if the tool is fixed in the room, the object to be machined 
is fixedly mounted to the grip device of the robot. The measuring 
tip is mounted on the tool, or to the tool holder of the robot. If 
15 the tool is not fixed in the room, the tool is fixedly mounted to 
the tool holder of the robot. The measuring tip is moved forward 
and backward over the surfaces of the object, and meanwhile 
the robot follows the movements. In an alternative embodiment, 
the operator inputs information about which object to be used 
20 during calibration, and the system shows later, during the meas- 
uring with the robot, via a monitor, which surfaces to be scanned 
by the measuring tip. 

The control system of the robot calculates the positions of the 
25 points in any coordinate system of the robot. The measuring 
points are transferred to the classification module, which classi- 
fies the measuring points. The classified measuring points are 
transferred to the calibration module, which calculates error vec- 
tors in dependence of deviations between the measuring points 
30 and corresponding points on the CAD model. The calculating 
module also calculates the path correction vectors for subsur- 
faces of the object. The system can also, during measuring, do 
classification, calibration and calculation of path correction vec- 
tors, and determine, as new object surfaces are measured, 
35 when there are enough measuring points. A criterion showing 
that there are enough measuring points, is for example that the 
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standard deviation, during adaption of the measuring points to 
the geometrical model, is less than a determined value. When 
the criterion is fulfilled, the system informs the operator of the 
fact that the measuring is done. 

5 

When a sufficient number of measuring points have been fed to 
it, the system calculates the position and orientation of the ob- 
ject coordinate system, relative to the base coordinate system of 
the robot, and the correction vectors for the subsurfaces and 

10 line segments being generated. The correction vectors, and the 
position and orientation of the object coordinate system relative 
to the base coordinate system of the robot, is transferred to the 
adjusting module, which adjusts the positions defined for the ro- 
bot movement. The robot program is automatically generated 

15 based on the adjusted positions. 

In the following, running of a program generated in a CAD- 
module is described. The operator mounts the process tool, for 
example a polishing wheel. The robot path, defined on the ob- 

20 ject surfaces of the CAD model for TCP, is compensated with 
the correction vectors effective for the subsurfaces, through 
which the robot path passes. The corrected positions, and the 
object coordinate system calculated by the calibration module, is 
used for calculating the robot path in the robot base coordinate 

25 system. By means of the kinematic model, which is also used 
during the calibration, the shaft angles of the robot is calculated 
for the interpolated robot path and is used as a reference to the 
robot servo. 

30 In the following, programming of a robot path by lead through is 
described. The operator mounts the tool, to be used. The opera- 
tor moves the tool along the object to simulate the work to be 
performed by the robot. The system reads the positions of the 
robot axes, and calculates, by means of the robot kinematic that 

35 has been used during the calibration and the object coordinate 
system calculated during the calibration, the robot paths gener- 
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ated by the operator in the object coordinate system. The sys- 
tem adjusts the paths by means of the correction vectors that 
have been generated during the calibration of the subsurfaces. 
Thereby, the paths will be positioned on the object surfaces of 
5 the CAD model, and can later be used for running robot paths 
generated from CAD, for example in an other robot installation. 

Fig. 11 shows the program editing. The operator points with the 
measuring tip, or the tool, on an area 92 of the object surface, 

10 where the process has not achieved a good enough result, and 
informs the system about what is not good, for example by 
speech communication. The operator specifies how the path 
should be modified, for example "increase processor power" or, 
as shown in the figure, "reduce the distance to the object". The 

15 system collects data from the CAD model for the subsurfaces, or 
line segments being marked by the operator, and adjusts the ro- 
bot path for those subsurfaces, for example moves the path 
closer to the object surface, when the depth of the polishing 
shall be increased in the marked area. The robot path 94 is 

20 moved in the direction of the surface normal in that part of the 
path that is positioned within the area 92 marked by the opera- 
tor. To avoid that the modification becomes too abrupt, the new 
path is calculated with a soft transition into and out of the area 
92 marked by the operator. The adjusting of the path 96 is 

25 stored in the model of the CAD system. 

Fig. 12 shows measuring with a TCP fixed in the room. When a 
tool having a TCP fixed in the room is used, it is no longer suit- 
able to use the robot base coordinate system 32 to define the 

30 measuring points. Instead, the wrist coordinate system 100 of 
the robot is used. A measuring tip 102 fixed in the room is used 
during the measuring. The measuring points P n (X n ,Y n ,Z n ) are 
expressed in the wrist coordinate system 100. The object coor- 
dinate system 23, which is defined in the CAD-module, is posi- 

35 tioned and rotated relative to the wrist coordinate system 100, to 
obtain the best possible adaption to the measuring points. 
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Fig. 13 shows calibration of a tool 104 by means of a measuring 
tip 102 fixed in the room. The tool is mounted on the tool holder 
of the robot. A CAD model 105 for the tool is stored In the CAD- 

5 module. The CAD model of the tool is defined in a tool coordi- 
nate system 106. The orientation and position on the CAD model 
relative to the wrist coordinate system 100 is determined by 
adapting the CAD model 105 and the measuring points, marked 
with an x in the figure, in the best possible way to each other. 

10 The tool coordinate system 106, which is defined in the CAD- 
module, is positioned and rotated relative to the wrist coordinate 
system 100 to achieve the best possible adaption to the measur- 
ing points. When a TCP fixed in the room is used, the measuring 
tip is mounted on the wrist of the robot, and the measuring is 

15 performed as shown in figure 4. The same method can also be 
used for gripping devices and fixtures, if those exist as CAD 
models. 

In fig. 14 it is shown how the invention can be applied for arc 
20 welding. In an arc welding application the tools can by itself 
work as a measuring tip. However, if the welding wire is too 
weak for the programming, a measuring tip can be mounted di- 
rectly on the welding pistol by means of a protruding part, corre- 
sponding to the length of the welding wire. If no CAD model ex- 
25 ists, the system can still, by means of the measuring points, di- 
vide the object into plans, and calculate the intersection lines 
between the plans, and locate the robot path in the intersection 
lines, which facilitates for the operator. 

30 It is also possible to generate a CAD model by means of the ro- 
bot. The operator uses the robot for measuring one plane at a 
time, and he informs the system when he is about to measure 
the next plane. Alternatively, the system can have the necessary 
intelligence to decide how the measuring points shall be divided 

35 in a plane by the previously described classification method. 
The system does a least mean square adaption of a plane, for 
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example using "splines" to the measuring points being fed. The 
planes adapted to the measuring points, and the intersection 
lines of the planes are described in CAD model format, and is 
put into a CAD data base for use according to the previous de- 
5 scription of calibrating etc. Perhaps, the model generation can 
be done by iterations, wherein during a first iteration only a few 
measuring points are read, to obtain a rough CAD model, and 
thereafter the previously used methods are used. 

10 When there are kinematic errors of the robot, the measuring po- 
sition, measured by the robot, will be dependant on the tool ori- 
entation. To minimize this error, when the operator measures 
the object surfaces, he should use the tool orientation that will 
be used later when the robot shall execute paths on this sur- 

15 face. One way to force the operator to keep the correct orienta- 
tion during the measuring, is to let the operator first feed the 
measuring points without any high accuracy of the robot orienta- 
tion, and that the system later makes the adaption of the ob- 
tained measuring points, and then the operator redoes the 

20 measuring once again, but this time the system locks the tool 
orientation to the orientation which counts for the robot paths in 
respective object surface. This locking is made by force control 
of the robot; wherein the three degrees of freedom of the orien- 
tation are made stiff, while the three degrees of freedom for the 

25 positions are made soft. 

The kinematic of the robot is changed due to the temperature, 
fixtures wears, and robot components have to be changed. To 
avoid redoing the manual providing of measuring points for new 
30 coordinate system adaption, and path compensation, the meas- 
uring program, once made by the operator, can be stored in the 
system and then automatically be generated for a new measur- 
ing of object, tool, fixture etc. The robot is then run using force 
control, for example in admittance control mode. 



35 
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To secure the contact between measuring tip and object, the 
measuring tip may comprise a sensor (LVDT, force sensor, pres- 
sure sensor, optical sensor, eddy current sensor etc.). In the 
case of an electrically conducting object and tool, an electric 
5 circuit (preferably alternating) could also be connected between 
measuring tip and object. 

To make it easier for the operator during the measuring of the 
points on the object, speech communication can be used instead 
10 of having set of buttons and a monitor. 

While the measuring points are fed, the system may perform 
classification and best fit calculations, to inform the operator 
about how many measuring points that are needed to have 
15 enough accuracy in calibration and path compensation. 

It should be noted that the method trusts the repeat accuracy of 
the robot, and it does not need an expensive and accurate ro- 
bot, or a robot having a complicated software compensation of 
20 the kinematic parameter errors. 

An alternative to manually capturing measuring points, is to gen- 
erate a surface scanning program in the CAD system, which sur- 
face scanning program controls the movement of the robot dur- 

25 ing measuring of the measuring points. The positions of the 
measuring points are decided in the CAD system based on 
geometric model of the object, and input from the operator. 
Thus, during the robot programming in the CAD system, it is not 
only the position and orientation of the process path that is pro- 

30 grammed, but also a surface scanning program to provide 
measuring points on the surface of the object, which measuring 
points later is used as a basis for the calibration of the robot 
and the CAD model. 

35 In one embodiment, the user shows where to place all the meas- 
uring points on the object, and the path to be followed by the 
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robot during the measuring, by pointing on the CAD model of the 
object. Thereafter, a surface scanning program is automatically 
generated, which surface scanning program controls the move- 
ments of the robot during the measuring. In another embodi- 

5 ment, the user only shows the measuring points and the robot 
motion, necessary for performing the measuring, are automati- 
cally generated. In a third embodiment, it is enough if the opera- 
tor defines which surfaces to be measured, by pointing out those 
surfaces on the CAD model. Thereafter the CAD system gener- 

10 ates a surface scanning program for controlling the movements 
of the robot during the measuring. Besides which surfaces to be 
measured, the user also specifies the scanning density of the 
measuring. The CAD system lays out the positions of the meas- 
uring points in a raster, and later determines by means of known 

15 surface normal directions, which movement paths to be followed 
by the robot during the measuring. 

To minimize the influence of the kinematic error of the robot, it 
is advantageous to use the same tool orientation during the 
20 calibration as will later be used in the process program, i.e. the 
program which controls the process which the tool will carry out 
on the object. Thus, the orientation in a measuring point is ad- 
vantageously chosen to be the same as the orientation of the 
closest work point on the robot path. 

25 

Fig. 15a shows an object 110, and a process path 112 along 
which a tool 114 shall process the object. Fig. 15d shows the 
same object 110 having a number of measuring points 117 laid 
out by the surface scanning program. The measuring device 116 

30 is used during the calibration for measuring the measuring 
points 117 on the surface of the object. The orientation of the 
measuring device 117 in the measuring points is determined by 
the orientation of the tool 117 in the closest work point on the 
path 112. To be able to determine the position of the measuring 

35 points relative to the coordinate system of the robot, the meas- 
uring device 116 comprises a sensor 118. In an alternative em- 
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bodiment the current tool is used instead of the measuring de- 
vice, which tool is provided with a sensor mounted directly on 
the tool. The sensor should have a TCP relative to the tool TCP 
that is known to the CAD system. 

5 

The sensor 118 can be of two different types, for example a 
sensor detecting when it is in contact with the surface of the ob- 
ject, and then generating a signal to the robot, which then gen- 
erates a measuring point corresponding to the position of the 

10 robot. This function is called search stop. Examples of suitable 
sensors for search stop are a force sensor and a pressure sen- 
sor. At search stop, an electrical contact function may also be 
used. To make it possible to determine the positions of the 
measuring points on the surface of the object in the robot coor- 

15 dinate system, the distance between a part of the robot, pref- 
erably the tool holder of the robot, and the TCP of the position- 
ing sensor has to be known. 

A disadvantage with the use of search stop is that the measur- 
20 ing method will become slow, due to the fact that the robot has 
to keep a low velocity when it approaches the surface otthe ob- 
ject. An alternative is instead to use a sensor measuring the dis- 
tance between a part of the robot, preferably the tool holder of 
the robot, and the surface of the object. A suitable sensor is for 
25 example a LVDT sensor. During measuring with a LVDT sensor, 
contact between the surface of the object and the sensor is re- 
quired during the measuring. It is also possible to use a sensor 
adapted for contactless measuring, for example sensors based 
on laser, ultra sonic, eddy current, induction, micro wave, air 
30 flow and capacitance measuring. 

During the measuring, the positions of the measuring points are 
determined relative to the base coordinate system of the robot. 
The surface scanning program does not only generate the meas- 
35 uring points, but also generates the path to be followed by the 
robot between the measuring points. The shape of this path de- 



WO 2004/071717 



31 



PCT/SE2003/002003 



pends on which type of sensor is used. For example, if a LVDT 
sensor is used, or any other sensor wherein contact with the ob- 
ject surface is necessary for the measuring, a robot movement 
is generated, first moving the robot to a position located at a 

5 distance from the measuring point, a so called moving position, 
and thereafter moving the robot in a direction towards the sur- 
face of the object until it reaches the measuring position. There- 
after the robot is moved outward again in a direction away from 
the surface of the object to another moving position at a dis- 

10 tance from the surface of the object. Such a robot path is shown 
in fig. 16, wherein the moving points are denoted 119. If a sen- 
sor for contactless measuring is used instead, the programmed 
movement can be performed parallel to the surface of the object 
during the measuring. Fig. 17 shows an example of an automati- 

15 cally generated robot path for measuring points on the surface 
of the object with a sensor 230 for contactless measuring. The 
sensor 230 is a distance measuring laser probe of a triangula- 
tion type. 

20 Due to the fact that the robot is not yet calibrated relative to the 
object when the measuring points are generated in the CAD sys- 
tem, there is an uncertainty about where the object is situated 
relative to the robot. If a sensor is used which requires contact 
with the surface of the object during the measuring, the surface 

25 scanning program has to consider the kinematic and geometric 
errors of the installation. For example, if the robot cell is cali- 
brated with an accuracy of 5 millimeter, there has to be a colli- 
sion free zone of at least 5 millimeter between the object and 
the TCP of the sensor in its rest position when the robot moves 

30 between the measuring positions. The measuring positions also 
has to be located at least 5 millimeter from the edges of the ob- 
ject, so that the robot will not fail to hit the object when it goes 
down towards the object surface to measure it. The measuring is 
made when the robot has moved the TCP of the sensor down 

35 towards the surface of the object. Thus, the surface scanning 
program has to be generated with enough margins. 
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In fig. 18 the upper figure shows an object surface 120 having 
manually positioned measuring points, and the lower left figure 
shows measuring points 117 automatically generated by the sur- 

5 face scanning program. The figure illustrates that the automati- 
cally generated measuring points have to be kept within an un- 
certain zone 122. The zone 122 represents the area in which it 
is uncertain if the object is there or not. Within this zone no 
measuring points should be generated. If the sensor in any way 

10 should fail to hit the object when the measuring device is moved 
down towards the surface of the object, the program should in- 
clude a function, which detects if the sensor has been moved 
too far, and which then interrupt the measuring of the measuring 
point. The left figure illustrates that it during measuring with an 

15 LVDT sensor also has to be margins during programming of the 
sensor movement in a direction towards a measuring point 117. 
The figure shows the uncertainty due to where the object sur- 
face actually is situated. The object surface is positioned some- 
where in the zone 124 shown in the figure. To be certain that the 

20 sensor will not fail to hit the surface, the measuring point 117 
should be placed at a distance corresponding to the accuracy, in 
the previous embodiment 5 millimeter, below the object surface 
in the CAD model. 

25 During calibration of the robot cell, a simple calibration of the 
tool and the object coordinate system is done at first. Then the 
sensor is mounted on the tool, or the measuring device is 
mounted on the robot, and the sensor TCP which is generated 
by the CAD system is possibly controlled by any known method. 

30 Thereafter the surface scanning program is loaded from the 
CAD system and is run by the control system, of the robot. The 
positions for the measuring points, measured by the robot, are 
stored. Thereafter the calibration is carried out by adapting the 
measured surfaces to the surfaces of the CAD model. When the 

35 measurings of the surface of the object is done, the sensor is 
taken away and the tool is made ready for process execution. 
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Then the process program from the CAD system can be loaded 
and run directly. The loaded program has been automatically 
adjusted by data from the surface scanning with regard to the 
object coordinate system and local correction vectors. 

5 

In case the accuracy in the robot cell is too bad, for example 
more than 20 millimeter, it may be necessary to adjust the CAD 
generated surface scanning program, or program a surface 
scanning program in the robot cell. In the first case, in which the 

10 surface scanning program is generated by the CAD program, the 
border of the object surface can be programmed by the operator 
for each object surface to be measured, whereupon the control 
system of the robot automatically adjust the existing program 
generated by the CAD. The border of the object surface is pro- 

15 grammed by the operator who is manually jogging the robot to 
points located along the borders of the object surface. 

An alternative to generating the surface scanning program in the 
CAD system, is to let the user himself generate a surface scan- 

20 ning program by using suitable programming means, for exam- 
ple in the control system of the robot. By jogging the robot to the 
object, the user shows where to start the program and the end 
position of the program. If necessary, the user may also show 
one or a plurality of positions on the object between the start 

25 and end position, for example to specify the bending and the di- 
rection of the measure movement. Based on the positions speci- 
fied by the user, the positions a surface scanning program is 
automatically generated, which generates the necessary number 
of measuring points to cover up the surface. 

30 

The user jogs the robot to a start position, to one or more inter- 
mediate positions and to an end position on the object. During 
programming, the sensor is moved to a suitable measuring posi- 
tion, for example in the middle of the work area for a LVDT sen- 
35 sor. Input data to the surface scanning program generation is 
measuring range of the sensor, sensor type, control type, and 
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desired density of measuring points, after which the surface 
scanning program is automatically generated. It is also possible 
to define a whole object surface, by specifying a plurality of 
points along the borders of the surface, wherein the scanning 
5 density is specified in two dimensions. 

An alternative to automatically generating a surface scanning 
program that automatically scans the measuring values, is to 
automatically generate measuring movements during jogging of 

10 the robot. For example, this can be done in such a way that 
when jogging a defined increment has been done, the jogging is 
locked, and a measure movement is carried out in the defined 
direction. When the measure has been finished, the jogging will 
start again. The direction of the measure movement can be de- 

15 fined by a simple two' points calibration. In this case, it may be 
suitable to use force control or soft servo to avoid erroneous 
jogging from destroying for example a LVDT sensor. The above- 
mentioned method for generating measuring points is useful 
both when the tool is fixedly mounted in the room, and on the 

20 robot. The method can also be useful for calibration of surround- 
ing equipment in a robot cell to the cell geometry of the CAD 
system. 

At manual programming of surface scanning, or at surface scan- 
25 ning jogging, there is also the application a process model, or a 
process database, uses the read geometry for calculation of op- 
timal process data, without generating the robot program from a 
CAD system. For example, a simple surface scanning may pro- 
duce the join data required for automatic adjustment of optimal 
30 arc welding parameters, such as welding current, voltage, proc- 
ess velocity and oscillation. 

In the case when you have smooth surfaces it is not necessary 
to go down with a measuring movement, and sample the posi- 
35 tion of the surface in discrete measuring points. Instead, the 
sensor can be moved over the surface and meanwhile continu- 
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ous measuring is made. However, this requires a sensor of 
LVDT type with possibilities for continuous measuring. This 
method is even necessary for accurate measuring of critical dis- 
continuities, such as for example an over lapping joint, wherein 
5 the scanning is performed from the upper surface to the lower. 

The invention is not limited to the embodiments shown, but can 
be varied and modified within the frame of the following claims. 



10 
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CLAIMS 

1. A method for programming an industrial robot (1) to move 
relative to defined positions on an object (4), wherein the pro- 

5 gramming is based on a geometric model (34) of the object, 
characterized in that the method comprises: 

registering and storing a plurality of measuring points, each 
measuring point corresponding to a point on the surface of the 
real object expressed in any coordinate system (32, 100) asso- 

10 ciated with the robot, 

determining the orientation and position of the geometrical 
model of the object relative to said coordinate system associ- 
ated with the robot by adapting the geometrical model of the ob- 
ject and the measuring points to each other, 

15 - calculating the deviation (48) between the measuring points 
(44) and corresponding points (45) on the geometrical model for 
at least some of the measuring points, and 
- adjusting said defined positions based on said calculated de- 
viations. 

20 

2. A method according to claim 1 , characterized in that it fur- 
ther comprises: 

calculating one or a plurality of characteristic parameters 
for a plurality of different parts of the object based on the geo- 
25 metrical model of the object, 

determining to which part (20, 21) of the object a measuring 
point belongs based on said characteristic parameters, and 

said adapting of the geometrical model of the object to the 
measuring points comprises adapting measuring points belong- 
30 ing to a certain part of the object to the corresponding part of 
the geometrical model. 

3. A method according to claim 2, characterized in that said 
parts comprise surfaces (20) and edge lines (21) of the object. 
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4. A method according to any of the claims 1-3, characterized 
in that it further comprises: 

providing geometric models for a plurality of different ob- 
jects, 

5 - calculating a plurality of characteristic parameters for each 
of the objects based on the geometrical model of the object, and 
determining to which of the objects the measuring points 
belong based on the measuring points and said characteristic 
parameters. 

10 

5. A method according to any of the claims 2-4, characterized 
in that said characteristic parameters comprise the normal direc- 
tion relative to the surface of the object and the bending (25) of 
the surface of the object. 

15 

6. A method according to any of the preceding claims, charac- 
terized in that the geometrical model of the object and the meas- 
uring points are adapted to each other by minimizing the dis- 
tance between the measuring points and corresponding points 

20 on the geometrical model of the object. 

7. A method according to any of the previous claims, charac- 
terized in that the surfaces of the object are divided into a plu- 
rality of sub-surfaces (42), each comprising at least one measur- 

25 ing point, calculating a correction vector (46) based on the de- 
viation (48) between the measuring point/measuring points in 
the sub-surface and corresponding point/points on the geometri- 
cal model of the object, and adjusting said defined positions 
based on the correction vectors for sub-surfaces belonging to 

30 the positions. 

8. A method according to any of the previous claims, charac- 
terized in that the edge lines of the object are divided into a plu- 
rality of line segments, each comprising at least one measuring 

35 point, calculating a correction vector based on the deviation be- 
tween the measuring point/measuring points in the line segment 
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and corresponding point/points on the geometrical model of the 
object, and adjusting said defined positions based on the correc- 
tion vectors for line segment in the vicinity of the defined posi- 
tions. 

5 

9. A method according to any of the preceding claims, charac- 
terized in that said defined positions are defined relative to the 
geometrical model and that the defined positions are trans- 
formed to said associated coordinate system based on the de- 

10 termined orientation and position of the geometrical model rela- 
tive to the coordinate system associated with the robot. 

10. A method according to any of the preceding claims, charac- 
terized in that said measuring points correspond to the positions 

15 of the robot when a predetermined point on a tool, or a measur- 
ing device (14) corresponding to the current tool, is in contact 
with different points on the surface of the object. 

11. A method according to any of the claims 1-10, characterized 
20 in that the method comprises generating a surface-scanning 

program for automatically controlling the movements of the robot 
during measuring of said measuring points. 

12. A method according to claim 11, characterized in that a 
25 sensor is mounted on a tool or on a measuring device corre- 
sponding to the current tool and that the sensor cooperates with 
the robot during generation of said measuring points. 

13. A method according to claim 12, characterized in that the 
30 surface scanning program controls the movements of the robot 

during measuring of the measuring points, wherein said move- 
ments comprises moving the robot so that the sensor is in con- 
tact with the surface of the object during the measuring and that 
the robot thereafter is moved to a transfer point positioned at a 
35 distance from the surface of the object. 
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14. A method according to any of the claims 12 and 13, charac- 
terized in that the orientation of the tool in the defined positions 
are stored and that the program is generated so that the tool or 
said measuring device have about the same orientation in a 

5 measuring point as the stored orientation. 

15. A method according to any of the claims 11-14, character- 
ized in that the positions of the measuring points are determined 
off-line based on the geometrical model of the object. 

10 

16. A method according to any of the claims 11-14, character- 
ized in that the method comprises that a number of positions, 
comprising at least one start position and one stop position are 
measured on the surface of the real object and that the positions 

15 of the measuring points are automatically generated based on 
the measured positions. 

17. A computer program directly loadable into the internal 
memory of a computer and comprising instructions to make a 

20 processor perform the steps in the method according to any of 
the claims 1-16. 

18. A computer readable medium comprising a computer pro- 
gram, comprising instructions to make a processor carry out the 

25 steps in the method according to the claims 1-16. 

19. A system for programming an industrial robot (1) to move 
relative to defined positions on an object (4), wherein the sys- 
tem comprises a geometric model (34) of the object, character- 

30 ized in that the system further comprises: 
the real object (4), 

an industrial robot (1), wherein the real object and the robot 
are arranged to that it is possible to, by means of the robot, 
generate a plurality of measuring points corresponding to differ- 
35 ent points on the surface of the real object expressed in a coor- 
dinate system (32, 100) associated with the robot, 
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a calibration module (17) arranged to determine orientation 
and position of the geometrical model of the object relative to 
said coordinate system associated with the robot by adapting 
the measuring points to the geometrical model of the object, 
5 - a calculating module (18) arranged to calculate the deviation 
(48) between the measuring points (44) and corresponding 
points (45) on the geometrical model, and 

- an adjusting module (19) arranged to adjust said defined po- 
sitions based on said calculated deviations. 

10 

20. A system according to claim 19, characterized in that the 
system comprises a measuring device (14) adapted for being in 
contact with the surface of the object during measuring, wherein 
the measuring device has a center point corresponding to the 

15 tool center point (TCP) of the current tool. 

21. A system according to claim 20, characterized in that the 
measuring device (14) is adapted to, at contact with the object, 
submit a signal, and that the system is adapted to, in reply to 

20 said signal, generate at least one measuring point based on the 
robot position. 

22. A system according to any of the claims 19-21, character- 
ized in that the system comprises a part classification module 

25 (16a) arranged to calculate one or a plurality of characteristic 
parameters for a plurality of different parts (20, 21) of the ob- 
ject, based on the geometrical model for the object, and to de- 
termine to which part of an object a measuring point belongs, 
based on said characteristic parameters, wherein said calibra- 

30 tion module (17) is adapted to execute said adaption of the geo- 
metrical model of the object to the measuring points by adapting 
the measuring points belonging to a certain part of the object to 
a corresponding part of the geometrical model. 

35 23. A system according to claim 22, characterized in that said 
parts comprises surfaces (20) and edge lines (21) of the object. 
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24. A system according to any of the claims 19-23, character- 
ized in that the system further comprises geometric models for a 
plurality of different objects and an object classification module 

5 (16b) arranged to calculate a plurality of characteristic parame- 
ters for each of the objects based on the geometrical model of 
the objects and to determine to which of the different objects the 
measuring point belongs based on the measuring points and the 
calculated characteristic parameters. 

10 

25. A system according to any of the claims 22-24, character- 
ized in that said characteristic parameters comprise the normal 
direction relative to the surface of the object and the bending 
(25) of the surface of the object. 

15 

26. A system according to any of the claims 19-25, character- 
ized in that said calibration module (17) is arranged for adapting 
the geometrical model of the object and the measuring points to 
each other by minimizing the distance between the measuring 

20 points and corresponding points of the geometrical model of the 
object. 

27. A system according to any of the claims 19-26, character- 
ized in that said adjusting module (19) comprises means for di- 

25 viding the surfaces of the object into a plurality of sub-surfaces 
(42), each comprising at least one measuring point and the ad- 
justing module is arranged to calculate a correction vector for 
the sub-surfaces based on the deviation between the measuring 
point/measuring points of the sub-surface and corresponding 

30 point/points on the geometrical model of the object, and to ad- 
just said defined positions based on the correction vectors for 
the sub-surfaces to which the positions belong. 

28. A system according to any of the claims 19-27, character- 
35 ized in that said adjusting module (19) comprises means for di- 
viding the edge lines of the object into a plurality of line seg- 
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ments, each comprising at least one measuring point and the 
adjusting module is arranged to calculate a correction vector for 
each line segment based on the deviation between the measur- 
ing point/measuring points in the line segment and correspond- 
5 ing point/points on the geometrical model of the object and to 
adjust said defined positions based on the correction vectors for 
the line segment in the vicinity of the defined positions. 

29. A system according to any of the claims 19-28, wherein said 
10 defined positions are defined relative to the geometrical model, 

characterized in that said adjusting module comprises means for 
transforming said defined positions to said coordinate system 
associated with the robot, based on the determined orientation 
and position of the geometrical model relative to a said coordi- 
15 nate system. 

30. A system according to any of the claims 19-29, character- 
ized in that the system comprises a program generator, ar- 
ranged for generating a surface scanning program for automati- 

20 cally controlling the movement of the robot during measuring of 
said measuring points. 

31. A system according to claim 30, characterized in that said 
program generator is arranged for automatically generate said 

25 surface scanning program based on certain input from an opera- 
tor. 

32. A system according to any of the claims 30 and 31, charac- 
terized in that the system comprises a sensor mounted on a 

30 tool, or a measuring device corresponding to the current tool, 
and that the sensor is arranged to cooperate with the robot for 
generating said measuring points. 

33. A system according to any of the claim 32, characterized in 
35 that said sensor is a position sensor arranged for measuring the 
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distance between the surface of the object and any part of the 
robot. 

34. A system according to any of the claims 32 and 33, charac- 
5 terized in that the surface scanning program controls the move- 
ment of the robot during measuring of the measuring points, 
wherein said movements comprises that the robot is moved so 
that the sensor is in contact with the surface of the object during 
the measuring and that the robot thereafter is moved to a trans- 
it) fer point being positioned at a distance from the surface of the 

object. 

35. A system according to any of the claims 30-34, character- 
ized in that the program generator is arranged in an external 

15 computer and that the program generator is arranged to deter- 
mine the positions of the measuring points based on the geo- 
metrical model of the object. 

36. A system according to any of the claims 30-34, character- 
20 ized in that the program generator is arranged in the control sys- 
tem of the robot and that the program generator is arranged for 
generating the positions of the measuring points based on a plu- 
rality of positions measured at the surface of the real object, 
which positions comprise at least one start position and one 

25 stop position. 
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